The newlywed couple is on an old two-seater bicycle